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ABSTRACT 



A system for processing audio and video components of 
a television signal provides for automatic control of 
closed caption signal display in response to the status of 
an audio muting feature. The system includes an operat- 
ing mode in which enabling audio muting also enables 
the closed caption display and disabling muting disables 
generation of the closed caption display. 

9 Oaims, 3 Drawing Sheets 
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1 

AUTOMATIC DISPLAY OF CLOSED CAPTION 
INFORMATION DURING AUDIO MUTING 

FIELD OF THE INVENTION 

The present invention relates to television systems 
which include provisions for processing auxiliary video 
information such as closed caption data. 

BACKGROUND 

The video signal processing section of a television 
system may include provisions for decoding and dis- 
playing auxiliary video information such as closed cap- 
tion data. Closed caption data includes ASCII digital 
data representing text corresponding the spoken audio 
information contained in a television signal. The closed 
caption data is displayed on the screen of the television 
system and is intended to provide a visible representa- 
tion of the spoken portion of a television program as an 
aid to hearing impaired television viewers. In the 
United StateSt the closed captioning standard is set forth 
in Federal Communications Commission (FCC) regula- 
tions (see e.g., 47 CFR §§ 15.119 and 73.682), FCC 
regulations specify that digital closed caption data is to 
be transmitted in line 21 of field 1 in the video signal. 
Data representative of two ASCII characters is trans- 
mitted in each occurrence of line 21 of field 1. Future 
modifications to the standard may provide for closed 
caption data to select be located in other lines, e.g., line 
21 of every field. 

Closed caption data is obtained from the video signal 
by a decoder. The decoded signal is coupled to the 
video display when the closed captioning function is 
enabled by a hearing impaired viewer. A hearing im- 
paired viewer may enable the closed captioning func- 
tion by activating a switch (e.g., located on a remote 
control unit or on a control panel on the housing of the 
television system itselO or by selecting the closed cap- 
tioning function from a menu displayed on the video 
screen during a control mode of operation. Once acti- 
vated, closed captioning remains enabled until disabled 
by the viewer. A viewer that is not hearing impaired 
would tend to disable closed captioning function to 
avoid having the closed caption display interfere with 
the displayed video program, 

A television system may also include an audio muting 
arrangement in the audio signal processing section. 
Activating the audio muting function causes the audio 
output from the television system to be disabled. The 
volume control setting is not affected so that when 
audio muting function is disabled, the normal audio 
output is reestablished without adjustment of the vol- 
ume. Audio muting may be activated, for example, via 
a remote control unit. 

Audio muting is useful in a variety of circumstances. 
For example, a user may wish to disable the audio out- 
put (i.e.. enable muting) when answering the telephone 
or during a conversation. Although audio muting is 
useful under these circumstances, a viewer may undesir- 
ably miss important spoken information of the television 
program being viewed while the audio is muted. 

SUMMARY OF THE INVENTION 

The present invention is directed to a system for 
processing a television signal in which a video signal 
processing channel includes provisions for decoding an 
auxiliary information signal component, such as closed 
captioning data, contained in the video component of 



the television signal and for including the auxiliary 
information signal in a video output signal, and in which 
an audio signal processing channel includes provisions 
for selectively disabling or otherwise inhibiting the 

3 generation of an audio output signal. Specifically, in 
accordance with the invention, the auxiliary informa- 
tion signal is automatically caused to be included in the 
video output signal when the generation of the audio 
output signal is inhibited or disabled. The auxiliary 

10 information signal is excluded from the video output 
signal when the normal generation of the audio output 
signal is no longer inhibited. 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 shows, in block diagram form, a portion of a 
television signal processing system including an em- 
bodiment of the present invention. 

FIG. 2 illustrates a flowchart of a subroutine of a 
control program which may be used to implement a 
portion of the embodiment shown in FIG. 1. 

FIG. 3 shows, partially in block diagram form and 
partially in logic diagram form, an implementation of a 
portion of the embodiment shown in FliG; 1. 

25 DETAILED DESCRIPTION OF THE DRAWING 

As shown in FIG. 1, a television signal processing 
system includes a video signal processing channel 100 
and an audio signal processing channel 150 for process- 
ing respective ones of a video component VIDEO IN 
and an audio component AUDIO IN of an input televi- 
sion signal. Video component VIDEO IN includes an 
auxiliary information component in the form of closed 
caption (CC) data which is derived from the video 

35 component by a closed caption decoder 110. On-screen 
display (OSD) processor 120 responds to signals includ- 
ing the decoded closed caption data to generate an 
on-screen display signal OSDOUT, OSD processor 120 
is enabled to produce a display of closed caption data in 

4Q response to an appropriate level (e.g.. a logic 1) of a 
signal CCEN. Other functions of OSD processor 120 
may include the generation of a channel number display 
and the generation of a function menu display. A func- 
tion menu permits a viewer to various functions of the 

45 television system such as the closed captioning function. 
To ensure that OSD information is displayed in the 
correct portion of the video display, the operation of 
OSD processor 120 is synchronized with the operation 
of video processor 100 in response to vertical and hori- 

50 zontal synchronization signals represented by signal 
SYNC in FIG. 1. When on-screen display information is 
to be displayed, a video switch 130 is caused to de- 
couple a signal VIDEO produced by video signal pro- 
cessing channel 100 from a video output, at which a 

55 video output signal VIDEO OUTPUT is produced, and 
to coupled signal OSDOUT produced by OSD proces- 
sor to the video output instead. Switch 130 responds to 
a signal OSDSEL produced by OSD processor 120 to 
select the source of video output signal VIDEO OUT. 

60 Switch 130 is caused to couple signal VIDEO to the 
video output to produce signal VIDEO OUT when 
signal OSDSEL is at the logic 0 level, and to couple 
signal OSDOUT to the video output to produce signal 
VIDEO OUT when signal OSDSEL is at the logic 1 

65 level. 

Audio signal processing channel 150 processes audio 
component AUDIO IN to produce a signal AUDIO. 
An audio mute function is provided by an audio switch 
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160 which operates in response to a signal MUTE. Dur- monitor the spoken portion of a television program and 

ing the normal audio reproduction mode of operation, thereby not miss spoken information even though the 

signal MUTE is at the logic 0 level causing switch 160 audio response is muted. 

to couple signal AUDIO to an audio output in order to The described functions of decode and control unit 
produce an audio output signal AUDIO OUT. When 5 140 may be performed by a microprocessor under ap- 
the audio muting function is enabled, signal MUTE is propriate software control. FIG. 2 shows a flowchart 
caused to be at the logic 1 level and switch 160 is, as a illustrating an approach to the microprocessor genera- 
result, caused to decouple signal AUDIO from the tion of signals CCEN and MUTE. When a muting 
audio output and to couple signal ground to the audio switch is activated (or the status of a menu item relating 
output instead. This prevents an audio response from 10 to muting is changed), the logic level of signal MUTE is 
being produced. toggled, as described above. In response to the change 
Signals CCEN and MUTE are generated by a decode in state of signal MUTE, the microprocessor enters the 
and control unit 140 in response to user input informa- routine shown in FIG. 2 at step 200. At step 210, the 
tion, indicated by signal USER INPUT in FIG. 1. For microprocessor determines whether or not the user has 
example, a television viewer may activate a MUTE 15 selected the "closed caption with audio" mode of opera- 
switch (not shown) on a remote control (not shown) to tion by testing a flag which is set when a user selects 
enable the audio muting function. Decode unit 140 de- that mode of operation. If the "closed caption with 
tects activation of the MUTE switch and provides an audio" mode is selected, a closed caption display is 
appropriate muting control signal MUTE. Activation generated at all times independent of the status of the 
of the MUTE switch causes the existing state of the 20. muting function. As a result, no testing of the muting 
muting control signal MUTE to be toggled. For exam- status is required and the microprocessor exits the rou- 
ple, if signal MUTE is at the logic 0 level, indicating tine in at step 290. 

that the muting function is disabled, activating the If the "closed caption with audio" mode is not se- 
MUTE switch will cause the level of signal MUTE to lected, the operation continues at step 220, where the 
change to the logic t level, thereby enabling the muting 25 status of the muting function is tested by testing the 
function. Conversely, when the muting function is en- state of a MUTE flag. If muting is enabled, the opera- 
abled, activating the MUTE switch will disable the tion proceeds from step 220 to step 240, where the mi- 
muting function. croprocessor determines whether or not the "closed 
Signal CCEN is generated in response to user input caption with mute" mode is selected by testing an ap- 
commands related to various closed captioning modes 30 propriate flag. If the "closed caption with mute" mode 
of operation. Conventional closed captioning modes of is selected, closed captioning is enabled at step 250 by 
operation may include enabling the closed captioning the microprocessor establishing the appropriate state of 
function at all limes for a hearing impaired viewer or signal CCEN (e.g., the logic 1 level) to enable closed 
disabling the closed captioning functioning at all times captioning. The microprocessor then exits the routine at 
for a viewer who is not hearing impaired. These modes 35 step 290. If the "closed caption with mute" mode is not 
of operation may be selected via an appropriate user selected, step 250 is bypassed and the microprocessor 
input device, e.g., by means of a remote control unit, a proceeds directly to step 290, where the routine is ter- 
control panel on the housing of the television system minated. 

itself, or a displayed function selection menu item. En- When the audio status test at step 220 indicates that 
abling the closed captioning function at all times pro- 40 muting is disabled, operation continues at step 280 
vides for the display of closed caption text whether the rather than at step 240. A necessary condition for reach- 
audio muting function is enabled or disabled. This mode ing the audio status test at step 220 is that the "closed 
of operation is referred to as the "closed caption with caption with audio" mode is not selected (test at step 
audio" mode. To enable and disable the "closed caption 210). Therefore, if step 220 indicates that muting is 
with audio" mode of operation, decode and control unit 45 disabled, closed captioning is disabled. This is accom- 
140 toggles the present state of signal CCEN in a man- plished at step 280. where closed captioning is disabled 
ner similar to that described with respect to control by establishing the appropriate state of signal CCEN 
signal MUTE, (e.g., the logic 0 level). Following step 280, the routine 

Decode and control unit 140 also controls both of is terminated at step 290. 
signals CCEN and MUTE together in order to provide 50 FIG. 3 shows a digital logic approach to implement- 
a new mode of operation referred to as the "closed ing certain functions depicted in the flowchart in FIG. 
caption with mute" mode in which the closed caption- 2. In FIG. 3, decode unit 300 may be hard -wired decode 
ing function is automatically enabled and disabled in logic or a microprocessor that interprets user com- 
response to enabling and disabling, respectively, the mands USER INPUT. Decode unit 300 generates vari- 
muting function. As with the "closed caption with au- 55 ous control signals including signals CC AUDIO, 
dio" mode, the "closed caption with mute" mode of CCMUTE, and MUTE. Signals CCAUDIO and 
operation may be selected by activating an appropriate CCMUTE indicate that the "closed caption with au- 
user input device. During the "closed caption with dio" and "closed caption with mute" modes of opera- 
mute" mode, when signal MUTE is set to the appropri- tion, respectively, are selected. Signal MUTE is repre- 
ate logic level for enabling the audio muting function, 60 sentative of the muting status as described above. All 
signal CCEN is automatically set to the appropriate three signals are held constant by decode unit 300 until 
logic level to cause OSD processor 120 to produce a the states of the closed captioning or muting functions 
closed caption display. Conversely, when signal MUTE are changed in response to a user's command, 
is set to the appropriate logic level for disabling the In the arrangement shown in FIG. 3, signal CCAU- 
audio muting function, signal CCEN is automatically 65 DIO being at the logic 1 level indicates that the "closed 
set to the appropriate logic level to cause OSD proces- caption with audio" mode is selected. OR gale 350 
sor 120 to end the closed caption display. The "closed responds to signal CCAUDIO being at the logic 1 level 
caption with mute" mode allows a viewer to visibly by causing signal CCEN to be at the logic 1 level, 
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thereby enabling closed captioning independent of the 
level of signal MUTE. If the "closed caption with au- 
dio" mode is not selected (i.e., signal CCAUDIO is at 
the logic 0 level), closed captioning is enabled via AND 
gate 340 when the "closed caption with mute" mode is 5 
selected (i.e., signal CCMUTE is at the logic 1 level) 
and muting is selected (i.e., signal MUTE is at the logic 
1 level). Signal CCEN is at the logic 0 level (i.e., closed 
captioning is disabled) if signals CCAUDIO and 
CCMUTE are both at the logic 0 level. The arrange- 10 
ment in FIG. 3 may be modified to accommodate en- 
abling closed captioning in additional operating modes 
by adding inputs to OR gate 350 to receive respective 
additional control signals. 

Either implementation of decode and control unit 15 
140, i.e. the microprocessor based control approach 
shown in FIG. 2 or the digital logic approach in FIG. 3, 
may be included within OSD processor 120. Also, vari- 
ous portions of the arrangement shown in FIG. 1, such 
as closed caption decoder 110, decode and control unit 20 
140, and OSD processor 120, may included in a single 
integrated circuit. 

Although the present invention is described in the 
context of user control of an audio muting function, the 
invention may also be useful in situations where muting 25 
is activated automatically during a particular operating 
mode of a television system. The embodiment may also 
be modified so that the closed captioning function is 
automatically enabled when the audio response is inhib- 
ited in some manner other than by completely disabling 30 
it. For example, the closed captioning function may be 
automatically enabled when the audio response is re- 
duced in volume to a preset level. In addition, the inven- 
tion may be useful in television systems that provide for 
processing types of auxiliary video information other 35 
than closed captioning data, such as teletext data. 

We claim: 

1. In a system for processing a television signal in- 
cluding a video component and a related audio compo- 
nent corresponding to respective visible and audible 40 
portions of the same television program, said audio 
portion containing a spoken portion related to said visi- . 
l5le portion of said television program, said video com- 
ponent containing an auxiliary information component 
corresponding to a visible representation of said spoken 45 
portion of said television program, apparatus compris- 
ing: 

means responsive to said video component for gener- 
ating a video output signal corresponding to said 
visible portion of said television program; 50 

means responsive to said auxiliary information com- 
ponent for selectively generating an auxiliary infor- 
mation output signal corresponding to said visible 
representation of said spoken portion of said televi- 
sion program related to said visible portion of said 55 
television program; 

means for including said auxiliary information output 
signal, when generated, in said video output signal 
for displaying said visible representation of said 
spoken portion of said television program together 60 
with said related visible portion of said television 
program; 

means responsive to said audio component for gener- 
ating an audio output signal corresponding to said 
audible portion of said television program; 65 

means for inhibiting the normal generation of said 
audio output signal during a predetermined operat- 
ing condition of said system; wherein 
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6 

said auxiliary information output signal generating 
means is coupled to said audio output signal inhibit- 
ing means for generating said auxiliary information 
output signal during said predetermined operating 
. condition of said system when enabled to do so; 
and 

means are coupled to said auxiliary information out- 
put signal generating means for, in a first mode, 
enabling said auxiliary information output signal 
generating means to generate said auxiliary infor- 
mation signal during said predetermined operating 
condition of said system, and for, in a second mode, 
disabling said auxiliary information output signal 
generating means from generating said auxiliary 
information output signal during said predeter- 
mined operating condition of said system. 

2. The apparatus of claim 1 further comprising: 
means responsive to activation by a user for generat- 
ing a control signal; and wherein 

said audio output inhibiting means is an audio muting 
circuit responsive to said control signal for dis- 
abling the generation of said audio output signal to 
establish said predetermined operating condition; 
and 

said auxiliary information output signal generating 
means, in said first mode, is responsive to said con- 
trol signal for generating said auxiliary information 
output signal when audio muting is enabled and, in 
said second mode, is not responsive to said control 
signal for generating said auxiliary information 
output signal when said audio muting is enabled. 

3. The apparatus in claim 2 wherein said auxiliary 
information output signal is a closed caption signal. 

4. In a system for processing a television signal in- 
cluding a video component and a related audio compo- 
nent corresponding to respective visible and audible 
portions of the same television program, said audio 
portion containing a spoken portion related to said visi- 
ble portion of said television program, said video com- 
ponent containing an auxiliary information component 
corresponding to a visible representation of said spoken 
portion of said television program, apparatus compris- 
ing: 

means responsive to said video component for gener- 
ating a video output signal corresponding to said 
visible portion of said television program; 

means responsive to said auxiliary information com- 
ponent for selectively generating an auxiliary infor- 
mation output signal corresponding to said visible 
representation of said spoken portion of said televi- 
sion program related to said visible portion of said 
television program; 

means for including said auxiliary information output 
signal, when generated, in said video output signal 
for displaying said visible representation of said 
spoken portion of said television program together 
with said related visible portion of said television 
program; 

means responsive to user input for generating a con- 
trol signal indicative of an operating condition of 
said system; and 

means responsive to said control signal and to said 
audio component for generating an audio output 
signal in response to a first state of said control 
signal, and for inhibiting the normal generation of 
said audio output signal in response to a second 
state of said control signal; wherein 
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said auxiliary information output signal generating 
means is responsive to said second state of said 
control signal for generating said auxiliary informa- 
tion output signal when enabled to do so; and 
means are coupled to said auxiliary information out- 
put signal generating means for, in a first mode, 
enabling said auxiliary information output signal 
generating means to generate said auxiliary infor- 
mation output signal in response to said second 
state of said control signal, and for, in a second 
mode, disabling said auxiliary information signal 
generating means for generating said auxiliary in- 
formation output signal in response to said second 
state of said control signal. 
5. In a system for processing a television signal in- 
cluding a video component and a related audio compo- 
nent corresponding to respective visible and audible 
portions of the same television program, said audio 
portion containing a spoken portion related to said visi- 
ble portion of said television program, said video com- 
ponent containing an auxiliary information component 
corresponding to said spoken ponion of said television 
program, apparatus comprising: 
a video signal processing channel responsive to said 
video component for generating a video output 
signal corresponding to said visible portion of said 
television program; 
means responsive to said auxiliary information com- 
ponent for generating an auxiliary information 
output signal corresponding to said visible repre- 
sentation of said spoken portion of said television 
program related to said visible portion of said tele- 
vision program; 
an audio signal processing channel responsive to said 
audio component and to a control signal for selec- 
tively generating an audio output signal; 
means for generating said control signal such that said 
control signal exhibits a first state representative of 
a first operating condition of said system during 
which said audio output signal is generated, and a 
second state representative of a second operating 
condition of said system during which said audio 
output signal is inhibited; and 
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switching means for selectively including said auxil- 
iary information output signal in said video output 
signal; wherein 
said switching means is responsive to said second 

5 state of said control signal for including said auxil- 
iary information output signal in said video output 
signal for displaying said visible representation of 
said spoken portion of said television program to- 
gether with said related visible portion of said tele- 

10 vision program during said second operating con- 
dition of said system when enabled to do so; and 
means are coupled to said switching means for, in a 
first mode, enabling said switching means to in- 
clude said auxiliary information output signal in 

13 said video output signal when said system in is said 
second operating condition, and for, in a second 
mode, disabling said switching means from includ- 
ing said auxiliary information output signal in said 
video output signal when said system is in said 

20 second operating condition. 

6. The apparatus of claim 5 wherein said auxiliary 
information signal is a closed caption signal. 

7. The apparatus recited in claim 1, wherein- 
said means coupled to said auxiliary information out- 

2S put signal generating means is selectively enabled 
to generate or disabled from generating said auxil- 
iary information output signal during said predeter- 
mined operating condition in response to activation 
of an input device by a user. 

30 8. The apparatus recited in claim 4, wherein: 

said means coupled to said auxiliary information out- 
put signal generating means is selectively enabled 
to generate or disabled from generating said auxil- 
iary information output signal in response to said 

35 second state of said control signal in response to 
activation of an input device by a user. 
9. The apparatus recited in claim 5, wherein: 
said means coupled to said auxiliary information out- 
put signal generating means is selectively enabled 

40 to include or disabled from including said auxiliary 
information output signal in said video output sig- 
nal when said system is in said second operating 
condition in response to activation of an input de- 
vice by a user. 

45 ***** 
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